Adaptation to the Edge of Chaos in the Self-adjusting Logistic 

Map 

Paul Melby, Jorg Kaidel, Nicholas Weber, and Alfred Hiibler 

Center for Complex Systems Research, Department of Physics, University of Illinois at 
Urbana- Champaign, 1110 West Creen Street, Urbana, Illinois, 61801 

(February 8, 2008) 

Abstract 



Self-adjusting, or adaptive, systems have gathered much recent interest. 
We present a model for self-adjusting systems which treats the control param- 
eters of the system as slowly varying, rather than constant. The dynamics 
of these parameters is governed by a low-pass filtered feedback from the dy- 
namical variables of the system. We apply this model to the logistic map and 
examine the behavior of the control parameter. We find that the parameter 
leaves the chaotic regime. We observe a high probability of finding the pa- 
rameter at the boundary between periodicity and chaos. We therefore find 
that this system exhibits adaptation to the edge of chaos. 

PACS numbers: 05.65. -hb, 05.45. Pa, 05.45. Gg 
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Self-adjusting, or adapting, systems are ubiquitous in nature. Living systems are con- 
stantly changing their own properties in response to their environment. For example, the 
Asian firefly will adjust its flashing frequency to match the frequency of outside stimuli, 
such as the flashing of another flrefly [|l|. Because of the importance of adaptation in natu- 
ral systems, there have been many studies which try to characterize evolutionary, adaptive 
behavior 0,0]. Many of these studies show that adaptive systems will adapt to a new state at 
the boundary of chaos and order, called the edge of chaos. N.H. Packard showed that this 
effect occurred for a population of cellular automata rules evolving with a genetic algorithm. 
Pierre and Hiibler studied two competitive, adaptive agents which used both control and 
modeling to predict the behavior of the logistic map and found that, over time, the agents 
use a control which places the logistic map at the edge of chaos. The edge of chaos also 
occupies a prominent position because it has been found to be not only an optimal setting 
for control of a system [H, but also an optimal setting under which a physical system can 
support primitive functions for computation |^. 

We suggest a new model for self-adjusting systems, as proposed in Ritz and Hiibler 
0. An adjustable system is a system where the control parameters of the system are not 
constant in time. Control parameters are distinguished from dynamical variables through 
a separation of time scales, i.e. the control parameters vary much more slowly than do the 
dynamical variables 0. The dynamics of the control parameters is simple, over-damped 
motion without an attractor. If the forcing function for the parameter depends only on the 
system itself, the system is called self-adjusting. We examine using a forcing function which 
is a low-pass flltered feedback from the dynamical variables of the system. We apply this 
type of feedback to the logistic map and show that it exhibits adaptation to the edge of 
chaos. 

The logistic map has a dynamical variable a;„ and parameter a and is a function of time, 

n: 

Xn+l = CLXn{l — Xn) < < 1 < < 4 (l) 

The parameter a determines the type of dynamics which occurs for the dynamical variable, 
x„ 10. If < a < 3, then the dynamics of x„ has a stable flxed-point attractor. For 
intermediate values, 3 < a < 3.569 the dynamics of Xn is periodic. For 3.569 < a < 4, the 
dynamics of Xn is mostly chaotic. There are, however, values of the parameter in this range 
which lead to periodic behavior of x„. These values are called periodic windows, a = 3.84 is 
contained in the well known period 3 window. The edge of chaos refers to values of a which 
lead to periodic (chaotic) behavior in x„ and with only a small change would lead to chaotic 
(periodic) Xn dynamics. Thus, values of a which are very near to 3.569, or are very near to 
the periodic windows, are at the edge of chaos. 

If the parameter, a, changes slowly with time, as in: 

a-n+i = cin + efn < a„ < 4 = 0, 1, 2, . . . (2) 

where /„ is a forcing function, and e is a small constant, the logistic map becomes an ad- 
justable system. If the forcing, /„, is a function, g, of only the dynamical variable, Xn, the 
logistic map is self-adjusting. Because of the requirement of a separation of timescales, a 
low-pass fllter is a logical choice. By damping out the high frequency terms, both the re- 
quirements of overdamped motion and separation of timescales can be achieved. In addition, 
low-pass fllters are common in natural and experimental situations. 
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The low-pass filtering can be achieved in numerical simulations by a Fourier analysis of 
the time series for x„. If time steps are used, the Fourier sine and cosine coefficients are 
given by: /3„o = (l/N) Ei=o' x{t+n-N+l), a^k = (2/iV) Y.t=o x{t+n-N+l) sin(27rH/iV), 
and (3nk = {2/N) Et=o^ x{t + n - N + 1) cos{27ikt/N) for k = 1,2, {N - l)/2 where k is 
the frequency. If N is odd, an extra term is needed: (3n{N+i)/2 = (1/^) Stlo^ ^(^ + n — N + 
l)cos{7i{N + l)t/N). 

A low-pass filter with DC cutoff and a very low frequency cutoff would keep only terms 
a„i and (3ni- The back transformation would then become: 

27rTi 27rTi 
Xn = a„i sin(-^) + P^i cos(-^) (3) 

If the forcing is only applied once every N steps, and is evaluated when n is a multiple 
of N, fn becomes simply: 

_ j exN = epni ifn = iN • _ i 9 o fA\ 



Numerical simulations of the self-adjusting logistic map were performed. ^ 1 and 
e ^ 1 were used to ensure a good separation of timescales. Fig |I] shows the time dependence 
of 3 different initial parameter values. For ao = 3.5, there is no change in a with time. 
The limiting dynamics of Xn when a = 3.5 is periodic. However, the dynamics of a for 
both the initial values ao = 3.8 and ao = 3.9 shows a ragged time dependence until a value 
of a is reached that leads to a periodic limiting dynamics for a;„. The system leaves the 
chaotic regime and settles on a periodic dynamics. The limiting value of a leads to periodic 
behavior in x„. However, only a small change in this limiting value is necessary to create 
chaotic dynamics in x„. Therefore we say that the system has adapted to the edge of chaos. 

To illustrate adaptation, 300 initial values of the parameter, ao, were taken evenly over 
the interval [3.4:4]. Fig. ^ shows a histogram for the distribution of parameter values for two 
times, n = and n = 60000. As can be seen, the initial distribution is flat over the interval 
[3.4,4]. At n = 60000, the probability is very small for values of the parameter, a, whose 
limiting dynamics is chaotic. The probability is very high, however, for those values of a 
which have a limiting dynamics which is periodic. In most cases, the system has evolved to 
the periodic windows of the system, which are labeled in the flgure. This high probability at 
values of a which are at the edge of chaos is an alternative description of adaptation to the 
edge of chaos, and is satisfled by this system. Initial parameter values which lead to periodic 
behavior have not changed. This observation leads to an approximation for the behavior of 
the low-pass flltered dynamics, a;„: 

if a leads to chaotic x dynamics ,_s 
if a leads to periodic x dynamics 

where 5„ is a nonzero number. Equation ^ can be understood in terms of the recurrence 
time and power spectrum of the x„ dynamics of the logistic map. Periodic behavior has, 
by deflnition, a flnite recurrence time. This leads to a power spectrum which has a lowest 
frequency ljo, which is proportional to the inverse of the recurrence time. Chaotic dynamics, 
however, has an inflnite recurrence time and thus its power spectrum does not have a lowest 
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frequency component Therefore, if the cut-off frequency of the low-pass filter is cUc, a 
condition on the low-passed dynamics can be made: 



Xn{ci) =0 ii Uc < u!o{a) (6) 

where uJo{a) is the lowest frequency of the Xn dynamics with parameter value a. 

To understand the ragged time dependence in Fig. |I], we look at the autocorrelation 
function, C of the feedback, /„: 

^ n=S 

C{j) = {fnfn+j) = "7^ X! fnfn+j (7) 

n=0 

where S is the number of time steps taken while the parameter is still changing. A random 
data set will be 5-correlated, as in: 



C{0) 




(8) 



A comparison of the autocorrelation function of a random data set and the feedback, /„ is 
shown in Fig. 0. As can be seen, the feedback is very nearly 5-correlated, which means that 
the ragged time dependence observed in Fig. |I| is a diffusive, random walk motion. 

We have shown that, for the self-adjusting logistic map, initially chaotic states adapt to 
periodic states which are at the edge of chaos. Our model uses a low-pass filtered feedback 
from the dynamical variables to the parameter of the system. This approach is different from 
previous studies which have used cellular automata, genetic algorithms, or neural networks 
to drive the adaptation. Our model is much simpler, using only feedback for adaptation. 
A simple, feedback-based model is more applicable to many physical systems which do not 
have gene codes or memories. We feel that adaptation to the edge of chaos is a generic 
property of systems with a low-pass filtered feedback, independent of both the form of the 
low-pass filter and the specific system under study. The low-pass filtered feedback exploits 
basic properties of periodicity and chaos, and so adaptation toward the edge of chaos should 
be a common property of such systems. 

This research was supported by the Office of Naval Research Grant no. N00014-96-1- 
0335. 
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FIGURES 



FIG. 1. Time dependence of 3 initial parameter values, a = 3.5 corresponds to periodic 

motion, while a = 3.8 and a = 3.9 correspond to chaotic motion. The final value of = 3.8 is 
3.74 (period 5) and the final value of oq = 3.9 is 3.96 (period 4.) For this simulation, A'" = 20 and 
e = 0.1 were used. 

FIG. 2. Distributions of parameter values between 3.4 and 4. The initial distribution at n = 
is flat, and the final distribution at n = 60000 clearly shows a high probability at the edge of chaos, 
in the periodic windows. The period of each window is labeled above the corresponding peak. 
A'" = 20 and e = 0.1 were used in this simulation. 

FIG. 3. (a) shows the autocorrelation function for a random data set, while (b) shows the 
autocorrelation function for the feedback, /„. Both functions are normalized to C(0). N = 20 and 
e = 0.1 were used. 
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